On December 18, 2024, ZhiYuan Research Institute signed a strategic cooperation agreement with Tencent Group, aiming for in-depth collaboration in several areas, including large model research and development, exploration of cutting-edge artificial intelligence technologies, and open-source ecosystem construction. According to the cooperation agreement, ZhiYuan Research Institute and Tencent will leverage their respective strengths to promote the deep integration of large model technology and industrial scenarios, and explore technological solutions for large model training and inference optimization in diverse computing environments. Both parties are also committed to building an open and innovative hardware and software ecosystem to foster the development and application of technologies.

Beijing Baidu Network Technology Co., Ltd. and Beijing Zhiyuan Artificial Intelligence Research Institute announced today the formal signing of a strategic cooperation agreement, under which the two sides will engage in deep collaboration in large model and other fields, jointly constructing an AI industry-research collaborative ecosystem. Baidu has been comprehensively laying out its artificial intelligence strategy since 2010 and is one of the few companies globally that has fully integrated its AI efforts, from Kunlun chips, PaddlePaddle deep learning platform, Wenxin large model to applications.

On September 4, 2024, the Beijing ZhiYuan Artificial Intelligence Research Institute (BAAI) announced the launch of the world's first model combat evaluation service featuring text-to-video, called FlagEval Large Model Arena. This service is open to users and covers approximately 40 large models from both domestic and international sources, supporting customizable online or offline evaluations for four major tasks: language Q&A, multimodal image and text understanding, text-to-image, and text-to-video.

ByteDance is secretly preparing to establish a Large Model Research Institute to strengthen its position in AI large models. The institute has attracted top talents from the industry, including Qin Yujia and Huang Wenhao, who will manage technology projects and report directly to founder Zhang Yiming. This move indicates ByteDance's long-term plans and proactive strategies in AI model R&D, aiming to leverage external expertise for technological a....

Long context understanding is a key challenge in the field of natural language processing, especially when large language models (LLMs) handle text that exceeds their context window size. To address this issue, researchers developed the LooGLE benchmark test, aimed at assessing LLMs' capability to understand extremely long documents (averaging 19.3k words, comprising 776 articles across multiple domains). LooGLE includes 7 tasks that cover both short and long dependencies, evaluating model understanding across texts of varying lengths. The test data is sourced from open-access content after 2022.

OpenAI CEO Sam Altman announced that OpenAI will provide early access to its new generative AI model for safety testing by the U.S. AI Safety Institute. This decision aims to counter accusations of neglecting safety in AI development, following criticism for disbanding a team focused on AI safety measures. In response to concerns, OpenAI pledged to allocate 20% more computing resources to safety research and removed non-disparagement clauses for ....

The Zhiyuan Research Institute recently released three new vector models that excel in vector retrieval tasks and have set new best standards across multiple evaluation benchmarks. The three models are: BGE-EN-ICL: an English vector model that enhances the model's semantic expression capabilities by introducing task-related query-document examples as few-shot examples.

Beijing Zhiyuan Artificial Intelligence Research Institute, in collaboration with China Telecom Artificial Intelligence Research Institute, has launched an upgraded version of the Tele-FLM series of large models, including the 52B instruction model FLM-2-52B-Instruct and the trillion-parameter model Tele-FLM-1T. The FLM-2-52B-Instruct focuses on enhancing Chinese conversational abilities through instruction fine-tuning, achieving 90% of GPT-4's capabilities, based on the Tele-FLM-52B base model, utilizing specific datasets and parameter optimization.

Researchers from Nanjing University and Megvii Research Institute have collaborated to bring a revolution to visual large models. Their proposed unsupervised paradigm, SeVa, successfully addresses the preference alignment issue of visual language models, and the entire process does not require the involvement of humans or GPT-4, significantly reducing alignment costs.

ZhiYuan Research Institute has released a code generation training dataset called TACO, aimed at providing more challenging training data and evaluation benchmarks for code generation models. TACO has advantages in terms of data scale, quality, and evaluation schemes, including a larger training and testing set, diverse problem-solving answers, and fine-grained labels. Experimental results show that current popular code generation models show significant differences compared to GPT-4 in TACO evaluations, indicating that there is still room for improvement in this field. TACO is not just a challenging...

["ZhiYuan Research Institute has released the new generation multimodal foundation model Emu2, pushing the boundaries of multimodal contextual learning capabilities.", "Emu2 surpasses Flamingo-80B and IDEFICS-80B, demonstrating excellent performance in few-shot multimodal understanding tasks.", "Emu2 achieves optimal performance in multiple few-shot understanding, visual question answering, and image generation tasks.", "Emu2-Chat realizes accurate understanding of text-image instructions, while Emu2-Gen offers flexible, controllable, high-quality images."]

Happy Auto officially established the AI Automotive Research Institute and appointed Gu Lei as the director to formulate the company's artificial intelligence application development plan. Happy Auto is actively seeking collaboration with artificial intelligence companies to jointly create smart, safe, and efficient automotive travel products and services. Lin Mingjun, Chairman and CEO of Happy Auto, stated that AI automobiles are the future development trend, and transitioning to new energy vehicle manufacturing requires improvements in software.

iFLYTEK and Shenhao Technology have signed a cooperation agreement to jointly establish an Industrial AI Robot Research Institute, achieving deep integration of large models and industrial robots. They will be the first to implement engineering applications in the power industry and promote in-depth cooperation in industrial health in fields such as energy, electricity, and mining. Both parties will work closely together to drive innovation in intelligent industrial robots.

["The Southern University of Science and Technology and the IDEA Research Institute CCNL Center have released SUS-Chat-34B, a bilingual model with a parameter scale of 34 billion.", "This model excels in various Chinese and English tasks, surpassing other models of the same parameter scale.", "SUS-Chat-34B is fine-tuned from the pre-trained model 01-ai/Yi-34B using millions of high-quality, multilingual instruction data.", "The model has a large-scale complex instruction following dataset and strong capabilities." ]

ZhiYuan Research Institute, in collaboration with TuoSi and ZhongKe WenGe, has jointly established the 'Chinese Internet Corpus' (CCI). This corpus has undergone strict screening and cleaning, with a data scale of 104GB, covering the period from 2001 to 2023. ZhiYuan Research Institute will continue to expand data sources and improve data processing workflows to provide more high-quality and reliable data resources. The institute has also opened up other high-quality Chinese datasets, such as WUDAO corpus, COIG, and MTP. This initiative aims to support the big data and artificial intelligence industries.

ZhiYuan Research Institute has open-sourced the JudgeLM evaluation model, which can efficiently assess various large models and provide scores. Compared to GPT-4, JudgeLM's cost is only 1/120, with a consistency rate of over 90% for evaluation results. JudgeLM can be applied in various assessment scenarios including pure text and multimodal contexts, generating scores and justifying reasons. The consistency of JudgeLM with reference answers exceeds 90%, approaching human performance. ZhiYuan Research Institute has also released datasets for training and validation samples for in-depth research on large models.

["ZhiYuan Research Institute has recently open-sourced the Uni3D model with 1 billion parameters, designed for general 3D vision tasks.", "The model can process point cloud data and has achieved breakthroughs in mainstream 3D vision tasks.", "Uni3D employs a unified Transformer architecture and introduces a multimodal alignment training method.", "The model has achieved state-of-the-art results across various 3D vision tasks.", "ZhiYuan Research Institute states that the open-source release of Uni3D will contribute to the future of 3D computing."]

ZhiYuan Research Institute has unveiled the new open-source bilingual model Wudao・Tianying 34 Billion Aquila2-34B, which excels in reasoning, generalization, and more. The institute has also released a comprehensive open-source toolkit to promote collaborative innovation in large model research. Aquila2-34B surpasses other open-source foundational models in overall capabilities, with the ZhiYuan team developing the NLPE method to enhance the model's extension capabilities.